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Abstract 

We survey and unify results on elimination of dominated strategies 
by monotonic dynamics and prove some new results that may be seen 
as dual to those of Hofbauer and Weibull (J. Econ. Theory, 1996, 
558-573) on convex monotonic dynamics. 

Key- words: evolutionary dynamics, dominated strategies 

1 Introduction 

A key issue in evolutionary game theory is whether evolutionary consider- 
ation lend support to rationality based concepts. The most basic of these 
concepts is perhaps that strictly dominated strategies should not be played. 
Accordingly, whether evolutionary dynamics wipe out dominated strategies 
has been studied by a number of authors (Akin, 1980; Nachbar, 1990; Dekel 
and Scotchmer, 1992; Samuelson and Zhang, 1992; Cabrales and Sobel, 1992; 
Hofbauer and Weibull, 1996; Cabrales, 2000; Berger and Hofbauer, 2005; 
Mertikopoulos and Moustakas, 2010; Hofbauer and Sandholm, 2011, and 
others). Many results concern deterministic monotonic dynamics and are 
proved in a very similar way. We unify these results, and prove some new 
results on concave monotonic dynamics (defined in the next section). These 
may be seen as a dual of Hofbauer and WeibuU's (1996) results on convex 
monotonic dynamics. 

The material is organized as follows. In the next section, we precise the 
framework and define several classes of dynamics. The main results are given 
in section |3] for continuous-time dynamics and in section |4]. for discrete-time 
dynamics. Section [5] gives examples of survival of strictly dominated strate- 
gies for single-population dynamics. Section[6]reviews more general dynamics 
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and section [7] discusses the concept of mixed strategy elimination. Appendix 
\K\ deals with elimination of iteratively strictly dominated strategies. Finally, 
Appendices [B] and [C] provide details on some proofs. 



2 Framework and classes of dynamics 

The setting we introduce is rather abstract in order to encompass a variety of 
situations, including 1-player games (decision problems), single population 
dynamics, and multipopulation dynamics where the different populations 
need not evolve according to the same dynamics. 

We consider a large population of players from which individuals are 
repeatedly and randomly drawn to play a game against some unspecified 
opponent. For instance, if the underlying game is a n-person game, then we 
focus on player 1, which we call the focal player, and consider players 2 to 
as a single entity, which we call the opponent (whether players 2 to n can 
correlate their actions or not will not be relevant). 

We assume that the set of pure strategies of the focal player is finite and 
denote it by I := {1,...,A^}. The set Sopp of strategies of the opponent is 
compact. We denote by or A(/) the — 1 dimensional simplex over J: 



and by int Sjy '■= {x G S'at : Vi G /, Xj > 0} its interior. Let Xj(t) denote the 
frequency of strategy i at time t in the focal population, and x(t) := {xi(t))i^j 
the vector of these frequencies. Let y{t) be the opponent's strategy at time 



The payoff of the pure strategy i against strategy y is denoted f/i(y), 
where f/j : Sopp — )■ M is continuous. The payoff of the mixed strategy p is 
Upiy) '■= Ylii^^iViUiiy)- Vectors are in bold characters. 

Dynamics We assume that the focal population adapts to the oppo- 
nent's strategy through some biological or sociological process (imitation, 
selection,...). This is modeled by assuming that ^{t) follows a differential 
equation. We focus on dynamics of the form: 



^If the game models an interaction with an individual of another population, then y{t) 
is the mean strategy in this other population; if it models a symmetric interaction with 
an individual of the same population, then y(i) = x(i). 




Xi{t) = Xi{t) ^,(x(t),y(t)) - ^Xfc(t)^fc(x(t),y(t)) 



(1) 
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To ensure uniqueness of the solution through each initial condition, we as- 
sume that the functions Qi and y are locally Lipschitz. The simplex and 
its faces are then invariant under ([T|. 

This class of dynamics includes the payoff functional dynamics 

X, = X, [/(f/.(y)) - f] (2) 

where / : M — M is Lipschitz continuous and / = Xlie/ ^ifiUiiy))^ with time 
indices suppressed. An interpretation of ^ is that Ui{y) is a material gain 
(food, territory, money,...) and f{Ui{y)) its translation in terms of fitness. 
The replicator dynamics (Taylor and Jonker, 1978) corresponds to / linear, 
that is when the payoffs are directly measured in terms of fitness. 



Domination and elimination As usual, we say that the mixed strat- 
egy p strictly dominates the mixed strategy q if f/p(y) > U^iy) for all y 
in Sopp- Throughout, we focus on strict domination, and write "dominated" 
for "strictly dominated". The pure strategy i is eliminated under a solu- 
tion x(-) of ([T]) if Xi{t) — )■ as t — +oo; it survives otherwise. Following 
Samuelson and Zhang (1992) and Cabrales (2000), we say that the mixed 
strategy q G Sn is eliminated if min{jg/:g.>o} Xj(t) — )■ (or equivalently 
Ylif^i^Ti^) ~^ 0)- discuss the usefulness of this concept in section [7j 

Classes of dynamics We want to find conditions on dynamics of type 
Q that ensure that dominated strategies are eliminated, or conversely, that 
dominated strategies survive in some games. To formulate these conditions, 
let us call gi{'x(t),'y(t)) the (unnormalized) growth rate of strategy i at time 
t. By analogy, we call growth rate of the mixed strategy p the quantity 

^p(x,y) := ^Pi^»(x,y) (3) 

Definition. A dynamics ([T]) is aggregate monotonia (Samuelson and Zhang, 
1992) if the growth rates of mixed strategies are ordered by their payoffs: for 
any mixed strategies p and q in S'at, 

V(x, y) G Stv X Sopp, f/p(y) > t/q(y) ^p(x, y) > ^q(x, y) (4) 

It is monotonia if Q holds whenever p and q are pure strategies, and aonvex 
monotonia (Hofbauer and Weibull, 1996) if ^ holds whenever q is pure. It is 
aonaave monotonia if Q holds whenever p is pure. Examples of convex and 
concave monotonic dynamics are discussed by Hofbauer and Weibull (1996)]^ 



^Monotonicity (Samuelson and Zhang, 1992) is called relative monotonicity by Nachbar 
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To understand these names, note that a payoff functional dynamics ^ 
with / increasing is convex (resp. concave) monotonic if and only if / is 
convex (resp. concave). It is aggregate monotonic if and only if / is linear, 
in which case ^ is the replicator dynamics]^ 



3 Intuition and main results 

Intuition. Convex monotonic dynamics favour mixed strategies over pure 
ones in that a payoff advantage of a mixed strategy over a pure one always 
translates in a higher growth rate; thus they should eliminate dominated 
pure strategies, but not necessarily dominated mixed strategies. Similarly, 
concave monotonic dynamics favour pure strategies, thus should eliminate 
mixed strategies dominated by pure ones. 

Aggregate monotonic dynamics are a limit better payoff always 

translates in a higher growth rate, hence all dominated strategies are elim- 
inated. The same holds for monotonic dynamics when restricting attention 
to pure strategies. Formally: 

Proposition 1 Let p and q be two mixed strategies. Ifp strictly dominates 
q then, under any aggregate monotonic dynamics and for any interior initial 
condition, q is eliminated. 

The same result holds for monotonic dynamics when p and q are both 
pure, for convex monotonic dynamics when q is pure, and for concave mono- 
tonic dynamics when p is pure^ 

For generalizations to elimination of iteratively dominated strategies, see 
Appendix |X| Before providing a formal proof, we note that these results are 
sharp in the class of payoff functional dynamics (|2]): 



(1990), order- compatibility by Friedman (1991), and payoff monotonicityhy Hofbauer and 
WeibuU (1996). The definition of concave monotonic dynamics is new but related dynamics 
are studied by Bjornerstedt (1995). 

•^Samuelson and Zhang (1992) have shown that in bimatrix games, for any aggre- 
gate monotonic dynamics, there exists a positive speed function A such that x(t) = 
X{x{t),y{t))-kREp{t), where xrep = x^{Ui{y) - C/x(y))- For single-population dynam- 
ics (y(t) = x(t) Vi), this implies that any aggregate monotonic dynamics has the same 
orbits than the replicator dynamics; for multi-population dynamics, this need not be so, 
because the speed function is population specific. 

''For multipopulation dynamics, these results are due to Akin (1980) for the replica- 
tor dynamics, Nachbar (1990) for monotonic dynamics, Samuelson and Zhang (1992) for 
aggregate monotonic dynamics and Hofbauer and Weibull (1996) for convex monotonic 
dynamics. The result on concave monotonic dynamics seems to be new. 
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Proposition 2 Consider a payoff functional dynamics If f is not con- 
vex, then ^ need not eliminate strictly dominated pure strategies: there 
exists a game with a strictly dominated pure strategy that survives for some 
interior initial conditions and some opponent's behaviors. 

Similarly, if f is not concave, then need not eliminate mixed strategies 
dominated by a pure strategy; if f is not linear (resp. not increasing), then 

need not eliminate mixed strategies dominated by another mixed strategy; 
(resp. pure by pure). 

The result on convex monotonic dynamics is due to Hofbauer and Weibull 
(1996). Tlie others seem to be new. 

Proof of proposition [ij First consider aggregate monotonic dynamics: 
let p and q be mixed strategies such that p strictly dominates q. Since the 
dynamics is aggregate monotonic, it follows that (7p(x, y) > (7q(x, y) for all 
(x, y) G S'at X Sopp. By compactness of Sn x S'opp, there exists e > such 
that 



Fix an interior solution x(-) and let w(t) := J2iei(Pi ~ ^^^i(f )- By at 
any point in time, 



Therefore, limj_j.+oo u'(t) = +oo. Since ^jg/Pi InXj(t) < (as Xj < 1), this 
implies that 1i^^^i(f) ~^ —oo. Therefore Ylii^i ^ii'^Y' ~^ Q is 
eliminated. 

The proof for the other classes of dynamics is the same, up to replacement 
of p, q, or both, by pure strategies. ■ 

Proof of proposition [2], The case / nonincreasing is obvious. The case 
/ nonlinear follows from the cases / nonconvex and / nonconcave, which we 
now deal with. Assume first that / is not convex. Since / is continuous (as 
assumed throughout), there exist real numbers a, b, and e > such that 





w = 



^(Pi-Qi)— = ^iPi- qi)9i{^,y) = ^p(x,y) - ^q(x,y) >e (6) 





Consider the 3x2 game with payoff matrix: 



L 



R 



T 
M 
B 
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The pure strategy M is strictly dominated by q = (1/2,0,1/2). But if, 
approximately, y{t) = L half of the time and y{t) = R the other half, then 
the average (unnormalized) growth rate of strategies T and B is close to 
[/(a) + /(6)]/2, while the average growth rate of strategy M is /([a + b]/2 — 
e) > [f{a) + f{h)]/2. It follows that xm — ^ 1, hence strategy M survives. 

If / is not concave, then take a, 6, and £ > such that ■^'-"•'^•^ > 
/ Consider the same game as rt8|, but with —e changed into 

+e. Strategy q is strictly dominated by M. But against the same oppo- 
nent's behaviour, the average growth rate of strategy q is now higher than 
the average growth rate of M. It follows that xm — ^ 0. Choosing y{t) 
periodic and respecting the symmetry between strategies T and B ensures 
that xt/xb remains bounded. Together with xm — ^ 0, this implies that 
Yim'm.it^j^ooXT{t)xBif) > 0, hence q is not eliminated. For details see Ap- 
pendix [B} ■ 

As detailed in Appendix C, a variant of this proof shows that proposition 
|2] extends to the wider class of payoff functional dynamics considered by 
Hofbauer and WeibuU (1996). 



4 Discrete-time dynamics 

Dekel and Scotchmer (1992) show that the discrete-time replicator dynamics 
need not eliminate pure strategies strictly dominated by mixed strategies. 
Thus, proposition [T] does not extend to discrete-time dynamics. To see why, 
consider the discrete-time dynamics: 

x,{n + 1 = Xi{n) r 9 

where x = x(n), y = y(n), and the constant C > — minj^x,y 5'i(x, y) may 
be interpreted as background fitness (Maynard-Smith, 1982). Eq. ^ is 
equivalent to 

/ , IN / N / N^i(x,y) - Efca;fcC/fc(x,y) 

Xi{n + 1) - Xi{n) = Xi{n) — — — r — (10) 

C + 2^fcXfc^fc(x,y) 

which is the Euler discretization of ([!]) with step size 1/[C + J^k-'^^dki^^y)]- 
The discrete-time replicator dynamics (Maynard-Smith, 1982) corresponds 
to 5'i(x, y) = Ui{y). Dekel and Scotchmer (1992) take C = 0. 

Proposition [T] and |2] are based on the evolution of the quantity w := 
J^i&iili — Pi) InXj, where p and q are two mixed strategies. In continuous- 
time, we had ([6|: w = X]ie/(^i ~ Pi)9i{^-,y)- But it follows from ^ that in 



6 



discrete-time, 

w{n + 1) - w{n) = ^(gi -pi)giix,y) with gi = In (C + gi) . (11) 



i6/ 



It follows that propositions [T] and [2] hold for (|9]) if we replace gi by when 
defining our classes of dynamics. This was first understood, and shown for 
aggregate monotonic dynamics, by Cabrales and Sobel (1992). 
For payoff functional dynamics 

x(n + 1)= xin) ^ + (12) 

xAn + 1) ^^^^^c + E.x,/(f/(fc,y)) ^''^ 

we get: 



Proposition 3 The dynamics (12) eliminates pure (mixed) strategies strictly 
dominated by mixed (pure) strategies if and only if ln(C + /) is increasing 
and convex (concave). It eliminates mixed strategies strictly dominated by 
mixed strategies if and only if ln(C + /) is increasing and linear. 

Since the logarithm is concave, dynamics that are aggregate monotonic in 
continuous-time become concave monotonic in discrete-time, and thus do not 
eliminate dominated pure strategies. Dekel and Scotchmer's (1922) example 
is an instance of this general result. 

For large C (a fine discretization), cji ^ InC + gi/C and discretizing 
concavities less the dynamics. If we first fix the game and the functions gi 
and then take C large enough, or if we let C depend on n, with C„ — )■ +oo 
(and J2n = +00 for the dynamics not to stop), then proposition [l] holds 
also in the discrete case, without modifying the definitions of the classes of 
dynamics (see Appendix [C] and Cabrales and Sobel, 1992). For more on 
discrete time dynamics, see Cabrales and Sobel (1992) and Bjornerstedt et 
al. (1996)0 

5 Survival of strictly dominated strategies in 
single-population dynamics 

Proposition |2] is easy to prove because the opponent's behaviour may be 
chosen ad-hoc. This section shows that similar results may be obtained with 



^ Bjornerstedt et al. (1996) consider an overlapping-generations dynamics which has as 
hmit cases the discrete-time and the continuous-time rephcator dynamics, for respectively 
no overlap and full overlap. The degree of overlap plays a role similar to that of the 
background fitness C in ([9]). They show that, for a fixed game, if the degree of overlap is 
large enough, strictly dominated strategies are eliminated. 
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more realistic opponent's behaviours. We first recall a result of Hofbauer and 
WeibuU (1996). 

5.1 Hofbauer and Weibull's result 

Consider a single population dynamics with a payoff functional form ([2]), with 
/ C^. Up to a change of time, and suppressing time indices, it may be written 
as Xi = Xi[f{Ui) — f] with Ui = ?7x(x) and / = Y^^XifiUi). Hofbauer and 
Weibull (1996) show that if / is not convex, then there are games where pure 
strategies strictly dominated by mixed strategies survive, for many interior 
initial conditions. The game they consider is a 4 x 4 two-player symmetric 
game. It is built by adding a fourth strategy to a generalized Rock-Paper- 
Scissors (RPS) game. The payoff matrix has the following structure: 

fa c ^ 7 \ 

h a c 7 

c h 07 

\a + /3 a + /3 a + /3 0/ 

where: (i) c < a < 6, (ii) {a + b + c) /?i > a + (3 and 7 > , and (iii) /3 > 0. 

By (i), the 3x3 base game is a RPS game, and by (ii), strategy 4 is 
strictly dominated by p = (1/3,1/3,1/3,0). Since (3 and 7 are positive, 
there is a rest point Zj in the relative interior of the edge connecting strategy 
i G {1,2,3} to strategy 4. It attracts any solution starting in the relative 
interior of this edge, and actually, any solution starting in the relative interior 
of the face Xj+i = 0, where i -t- 1 is counted modulo 3. It follows that the 
Zj form a heteroclinic cycle, that is, a loop of saddle rest points and orbits 
connecting them. Conditions (ii) and (iii) imply that (a + 6 + c)/3 > a (or 
equivalently, a < (6+c)/2). This implies that, under the replicator dynamics, 
the base game in an inward cycling RPS game (Hofbauer and Sigmund, 1998, 
p93; Gaunersdorfer and Hofbauer, 1995, p291). It may be shown that under 
the replicator dynamics (i.e. / strictly increasing and linear), any solution 
starting in the interior of the state space converges to the Nash equilibrium 
p = (1/3,1/3,1/3,0). In particular, strategy 4 is eliminated. However, if 
the function / is strictly increasing but not convex, then one may find such 
payoffs that furthermore satisfy /(a) > [/(6) -|- /(c)]/2. This means that in 
the RPS base game, even though the replicator dynamics is inward cycling, 
the current dynamics is outward cycling close to the RPS cycle; thus, this 
cycle is asymptotically stable on the face X4 = 0. As detailed by Hofbauer and 
Weibull, this implies that for /3 small enough, the heteroclinic cycle between 
the Zj is asymptotically stable. But along this cycle, X4 > 0. Thus, though 
strictly dominated, strategy 4 survives for an open set of initial conditions. 
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5.2 A dual result. 



Our aim is to give a dual example, showing that if / is strictly increasing and 
sufficiently regular but not concave, then mixed strategies that are strictly 
dominated by a pure strategy need not be eliminated. 

To simplify the exposition, we assume that / is different iable, with a 
strictly positive derivative, and that / is strictly convex. The strict convexity 
assumption may be replaced by any assumption that guarantees that / is 
strictly convex over some range, as we can always locate all the payoffs in 
this range. For instance, / and not concave suffices. 

Consider the game with payoff matrix 

fa c b 

. b a c 

c b a 

\ m + (3 m + (3 m + (5 

where m = (a + 6 + c)/3. Assume that : (i) c < a < 6, (ii) /3 > and 7 > 0, 
and (iii) a > {b + c)/2. Condition (i) means that the 3x3 base game is a RPS 
game; condition (ii) implies that strategy 4 strictly dominates the strategy 
p = (1/3, 1/3, 1/3, 0); condition (iii) implies that in the RPS base game, the 
replicator dynamics cycles outwards. 

Because / is strictly convex, we may find such payoffs that furthermore 
satisfy: (iv) /(a) < [/(6) + /(c)]/2. Consider ffist the dynamics on the face 
X4 = 0, that is, in the RPS base game. Condition (iv) implies that on this 
face, even though the replicator dynamics is outward cycling, our dynamics is 
inward cycling close to the RPS heteroclinic cycle, i.e. the relative boundary 
of this face is repulsive (Hofbauer and Sigmund, 1998; Gaunersdorfer and 
Hofbauer, 1995). Using a Taylor expansion of / near m, it may be shown 
that, close to the rest point p = (1/3,1/3,1/3,0), the dynamics behaves as 
if / was linear, that is, as the replicator dynamics. Due to condition (3) 
this implies that close to p (except exactly at p), the dynamics is outward 
cycling: X1X2X3 strictly decreases along trajectories (Figure 1)]^ 

By compactness, this implies that there exists p g]0, 1/27[ and a positive 
constant C such that, if a;4 = and X1X2X3 = p, then d{xiX2X^) / dt < —C. 

^Technically, fix a solution x(-) in the relative interior of the face — 0. Let v{t) = 
{xiX2X3Y/^ and w(i) = \nv{t). Let h(i) = x(i)-p. Thenio(<) = -[a-(6 + c)/2]||h(t)||2 + 
o(||h(t)|p), hence near p, by condition (iii), xiX2X^ decreases along trajectories. To obtain 
this expression of w, note that (Ax)^ — m ~ (Ah),, thus /((Ax),) = m + /'(m)(Ah)j + 
o([Ah),]). Using this and Yl,i — get w = — /'(m)h • Ah + o(||h|p). A standard 

computation shows that h • Ah — [a — [h + c)/2]||h(t)|p hence the result. This may be 
seen as a variant of exercise 8.1.1 in Hofbauer and Sigmund (1998). 



m — 7 \ 

m — 7 
m — 7 
m 



(13) 
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By continuity of /, this implies the existence of a small positive e such that, 
if X4 < e and XiX2X^ = p, then d{xiX2X^) / dt < —C/2. Furthermore, for 
/3 = 0, except if Xi = X2 = x^, the payoff of strategy 4 is less than the mean 
payoff: (Ax)4 < x- Ax (Viossat, 2007), hence 0:4 < by convexity of /. By a 
compactness and continuity argument, this implies that for /3 small enough, 
if X belongs to the compact set K = E : xiX2X'i < p and X4 < e}, then 
±4 < —C for some positive constant C. 

Now consider any solution with initial condition in K. The solution 
cannot leave K, which implies that it converges to the face X4 = 0. More- 
over, since on this face the relative boundary is repulsive, this implies that 
liminf X1X2X3 > 0. Thus, though p = (1/3, 1/3, 1/3, 0) is strictly dominated 
by strategy 4, it is not eliminated]^ 




Figure 1: Dynamics on the face X4 = 0. Both the center and the boundary 
are repulsive. In the neighborhood of this face, for suitable payoffs, X4 decreases 
outside a small neighborhood of (1/3, 1/3, 1/3, 0). Thus the limit cycle (or annulus) 
in the interior of this face is asymptotically stable in the whole game. Graphic 
produced with Dynamo (Sandholm et al., 2011). 



5.3 Discrete-time analog 



For discrete-time dynamics (12), the survival examples of sections 5.1 and 



5.2 go through if the assumptions on the convexity of / are replaced by 



'''This proof is similar to the proof that the Brown-von-Neumann-Nash dynamics may 
ehminate all strategies used in correlated equilibria (Viossat, 2008) 
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the corresponding assumptions on In /. Indeed, for reasons similar to those 
of section |4| the stabihty condition of the RPS cycle of the base game for 
Q is : In /(a) > [\nf{b) + ln/(c)]/2 (Gaunersdorfer, 1992, section 5 ; 
Hofbauer and Schlag, 2000, p533 ; see also Weissing, 1991). For Hofbauer 
and Weibull's result, the proof goes through with no other changes. For 
our dual result, two other ingredients are needed: first, (Ax)4 < x ■ Ax 
should imply /[(Ax)4) < Xj/[(Ax)j]; but if In / is convex, so is /, hence 
this holds. Second, in the RPS base game, X1X2X3 should decrease near the 
equilibrium. In continuous time, when a > [b + c]/2, this holds for any 
monotonic dynamics; but the discrete-time dynamics trajectories are tangent 
to their continous-time counterpart and the set of mixed strategies x such 
that X1X2X3 > A is convex; thus, under the discrete-time dynamics, X1X2X3 
decreases a fortiori (see also Hofbauer and Schlag, 2000, p534). The rest of 
the proof is unchanged. 



6 Other dynamics 

Continuous set of pure strategies Elimination of dominated strategies by 
monotonic dynamics is generalized to games with a continuous set of pure 
strategies by Heifetz et al (2007a, 2007b) and by Cressman and Hofbauer 
(2005) and Cressman et al (2006) [see also, Cressman, 2005] for the replicator 
dynamics. 

Stochastic dynamics Cabrales (2000) studies a stochastic version of the 
replicator dynamics and gives conditions under which dominated strategies 
are eliminated. Mertikopoulos and Moustakas (2010) show that for another 
version of the stochastic replicator dynamics, dominated strategies are always 
eliminated. 

Best-reply dynamics. Under the best-reply dynamics (Gilboa and Mat- 
sui, 1991; Matsui 1992), the frequency of pure strategies that are not best 
replies to the current strategy of the opponent decreases exponentially. It 
follows that strictly dominated pure strategies are eliminated. This extends 
to iteratively strictly dominated pure strategies. However, strictly dominated 
mixed strategies need not be eliminated. This follows from (Viossat, 2008) 
or from a variant of the proof of proposition ([2]). These results are not sur- 
prising, as the best reply dynamics may be seen as a limit case of convex 
monotonic dynamics (Hofbauer and Weibull, 1996) 

Survival of pure strategies strictly dominated by other pure strategies. 
Building on Berger and Hofbauer (2006), Hofbauer and Sandholm (forthcom- 
ing) [see also Sandholm (2011)] show that under a large class of dynamics, a 
pure strategy strictly dominated by another pure strategy may survive. Their 
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key feature is that, except at Nash equihbria, the growth rate of an unused 
best-reply is always positive. Combined with regularity requirements, this 
gives a small advantage to rare strategies which allows to maintain strictly 
dominated strategies at nonvanishing frequenciesF] 



One of the contribution of this article is to study elimination of dominated 
mixed strategies by concave monotonic dynamics. Elimination of dominated 
mixed strategies has a natural interpretation if we assume that agents may 
play mixed strategies, but even if we think that agents play only pure strate- 
gies, we find the concept useful on at least three grounds. First, to compare 
the outcome of evolutionary dynamics with rationalizable strategies (Bern- 
heim, 1984; Pearce, 1984). Second, to clarify the logic of Hofbauer and 
WeibuU's (1996) results by showing that elimination of pure strategies by 
convex monotonic dynamics and of mixed strategies by concave monotonic 
dynamics are two faces of the same coin. Third, to analyse the behaviour of 
some dynamics. 

Consider for instance a single-population dynamics modeling the evolu- 
tion of behavior in the two-player symmetric game 



The mixed strategy q = (1/2, 1/2, 0) is strictly dominated by the third pure 
strategy. Thus, if the dynamics is concave monotonic, then for any interior 
initial condition Xi{t)x2{t) — )■ 0, hence the solution converges to the union 
of the edges xi = and X2 = 0. Together with the dynamics on these edges 
(which is qualitatively the same for all monotonic dynamics), this implies 
that any interior solution converges to one of the three pure Nash equilibria, 
or to one of the rest points in the relative interior of these edges, that is 
(1/2,0, 1/2) and (0, 1/2, 1/2). This need not be the only way to prove this 
result, but probably the most elementary. 

^An example of a game and a dynamics such that a pure strategy dominated by all 
other pure strategies survives for most initial conditions is given by Bjornerstedt et al. 



7 Discussion 




(1996). 
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A Iterative elimination 



Proposition ([T]) extends to elimination of iteratively strictly dominated strate- 
gies. For simplicity, we focus on two-player finite games. The extension to 
n-player games is immediate. 

Let / and J denote the finite sets of pure strategies of player 1 and 
2, respectively, and for any finite set let ^{K) denote the simplex of 
probability distribution over K. Thus, the set of mixed strategies of player 
1 is A(/). 

Let = = I and = = A(/). Similarly, let = = J and 
= f^ = A(J). Inductively, let 1^+^ (resp. /^+\ S^+^ , S^^^) denote the 
set of strategies in (resp. I^, S^, S^) that are not strictly dominated by 
any strategy in (resp. A(J'^), JflS''^, S^) when player 2 chooses strategies 
in (resp. J*^, ^ T^). Similar definitions apply to player 2. 

Definition. A pure strategy i E I (resp. a mixed strategy x G A(/)) is 
iteratively strictly dominated by pure strategies if there exists A; in N such 
that i ^ (resp. x ^ S^). A pure strategy i e / (resp. a mixed strategy 
X G A(/)) is iteratively strictly dominated if there exists in N such that 
t i h (resp. X ^ 

Proposition 4 For every interior initial condition: ij hoth 'x.it) and ylt) fol- 
low a monotonic (resp. concave monotonic) dynamics, then every pure (resp. 
mixed) strategy iteratively strictly dominated by pure strategies is eliminated; 
if both x(t) and y{t) follow a convex (resp. aggregate) monotonic dynam- 
ics, then every iteratively strictly dominated pure (resp. mixed) strategy is 
eliminated. 

Proof. We first prove the result on convex monotonic dynamics. It 
follows from proposition [l] that the pure strategies in /°\/^ and in J°\J^ are 
eliminated. By induction assume that for k in N, the strategies in /°\/'^ and 
in J^\J^ are eliminated, hence in particular 

Vr/ > 0, 3r G M, Vt > T, max yj{t) < r] (14) 

jeJ\.P 

^ Since a pure strategy is also a mixed strategy, there seems to be two definitions of 
iteratively strictly dominated pure strategies, but they are equivalent. This is because 
iterative elimination of dominated mixed strategies boils down to iterative elimination 
of dominated pure strategies followed by one round of elimination of dominated mixed 
strategies, as is easily shown. Similarly, iterative elimination of mixed strategies dominated 
by pure strategies boils down to iterative elimination of pure strategies dominated by other 
pure strategies, followed by one round of elimination of mixed strategies dominated by 
pure ones. Thus, both definitions of pure strategies iteratively strictly dominated by pure 
strategies are also equivalent. 



13 



Let i G /^\/'^^^. Since strategy i is strictly dominated in the game restricted 
to P X J^, there exists e > 0, t] > and p E Sn such that 

max Vj <r]^ Ui{y{t)) < f/p(y(t)) + e 

Therefore, it follows from (14) and the proof of proposition [l] that strategy i 
is eliminated. The result follows. 

The proof for monotonic dynamics is identical up to replacement of I^, 
jk jk^ jk ^ q£ Up g g^ii g Concave monotonic dynamics 

eliminate pure strategies iteratively strictly dominated by pure strategies, as 
any monotonic dynamics, and then mixed strategies that become dominated 
by pure ones after this elimination, by an argument similar to the iteration 
step for convex monotonic dynamics. This and footnote |9] proves the result. 
The proof for aggregate monotonic dynamics relies similarly on the fact that 
they are convex monotonic and footnote [9j ■ 

These results are due to Nachbar (1990) for monotonic dynamics, Samuel- 
son and Zhang (1992) for aggregate monotonic dynamics and Hofbauer and 
WeibuU (1996) for convex monotonic dynamics. 

B Details on survival of dominated mixed strate- 
gies under non concave monotonic dynam- 
ics 



B.l For payoff functional dynamics ([2j) 

If / is not concave, then there exist reals a and h such that 



2 " V 2 

By continuity of /, there exists e > such that: 

„../M_;(^,,)>0 (15) 

Assume that player 1 plays a 3 x 2 game with payoff matrix: 





L 


R 




( a 


b 


il 








\ b 


a 
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Let yi{t) denote the probability at time t that the opponent chooses the left 
column. Fix some large positive constant T (more precisely, T > (2C + 
l)/a + l with C = max[a,6] |/|; this condition will appear later). Assume that 
the function yi{-) is 2T-periodic with yi(t) = 1 if t G [0,T — 1], yi(t) = if 
t e [T, 2T — 1], and linear variation on [T — 1,T] and [2T — 1, 2T]. 
Assume that x(0) G intS'Ar and let 

"■w - >" (^) w 

Letting gi{t) := f{Ui{y{t)), we have: 

ti^W = 92{t) 

hence 

w{{k + 1)T) - ?i;(A;T) = J \g2{t) 1 dt 

Since for all t, 5'2(i) = /((ct + 6)/2 + e) and since 

Vt G [kT, {k + 1)T - 1], g^{t) + g^{t) = f{a) + f{h) 



it follows from (15) that: 

w{{k + 1)T) - w{kT) < -{T - l)a + 2C 

with C = max[afe] |/|. Since we assumed T > {2C + 1)/q; + 1, it follows that 

w{{k + l)T) < w{kT) - 1 

Therefore w{kT) — )■ —oo as /c — )■ +oo. Since the variation of w between kT 
and {k + 1)T is bounded (less than 2CT), it follows that w{t) — )■ — oo hence 
X2{t) — > as t — )■ +00. Furthermore, it is easy to see by the same kind 
of computation that Xi(t)/x3(t) is 2T-periodic. It follows that xix^ 0. 
Actually, as is easily seen, 

inf Xi{t)x^{t) = min Xi(t)x3(t) > 

tm+ te[0,2T] 

Therefore, though q = (1/2,0, 1/2) is strictly dominated by strategy 2, the 
mixed strategy q is not eliminated 

-'^"Note also that for T sufficiently large or a;i(0) sufficiently close to 2:3(0), there exists t 
in [0, 2T] such that xi{t) = xslt), hence xi{t + 2kT) = xj,(t + 2kT) for all A: e N. Together 
with X2{t) — )■ 0, this implies that limsupt_j._,_oo xi(t)x^{t) — 1/4. 
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B.2 For the wider class of payoff functional dynamics 
considered by Hofbauer and Weibull (1996) 

In the context of n-player normal form games (hence with the opponent 
corresponding to players 2 to n), Hofbauer and Weibull (1996) consider payoff 
functional dynamics of the form (time indices suppressed): 

i;, = A(x,y)x4/(f/,(y))-/] (16) 

This is more general than ^ because the speed of the dynamics may now 
depend on the population's and opponent's mean strategies. Assuming that 
A is continuous, the previous proof is easily adapted to deal with these more 
general dynamics. 

Fix a large constant T. Let (t^) be a strictly increasing sequences of 
times, with to = 0. Assume that : 

(i) y(t) is piecewise linear, with for all n G N : yiit) = 1 on [tgnj^en+i], 
yiit) = on [tGn+3,tQn+4], yL{hn+2) = yL{t&n+b) = 1/2, and linear variation 
on [ten+i, ^6n+2], [^6n+2 , ^Gn+s] ; [^6n+4, ^Gn+s] and [tgn+s , ^Gn+e] • Furthermore : 

(ii) Choose ten+i and t^n+i such that 

I Kx{s),y{s))ds= I X{x{s),y{s))ds = T; 

(iii) Let ten+s = t&n+i + 1 and ten+e = t^n+A + 1; 

(iv) if a = 6, choose t6n+2 and ten+s arbitrarily in ]t6n+i, ^6n+3[ and 
]^6n+45 ^6n+6[; respectively. Otherwise, assume w.l.o.g. a < b, note that gi—g^ 
is negative on jten+i, ^6n+2[ and positive on ]t6n+2, hn+'A-, and choose t6n+2 such 
that jl2^'^[gi{i^{s),y{s))-g2,{^{s),y{s))]ds = 0. Similarly, choose ten+s such 
that 

/ [^i(x(s),y(s)) -^3(x(s),y(s))]rfs = 0. 
The same kind of computation as in the case A = 1 show that 

w{ten+6 - w{tQn) < -2Ta + 4:VmaxC 

where Vmax = max(x,y)g5jvx5oj,j, A(x,y), and C = max[a,b] |/|. Thus for T > 
'^VmaxC/a, w{t) ^t^+oo —oo. Thus X2(t) — )■ and Xi{t) + x^it) — )■ 1. 
Conditions (ii) and (iv) ensure that [xi/x3](t6n+6) = [a^i/a^3](^6n)- Together 
with xi(t) +X3(t) — i- 1, this implies that limsupxi(t)x3(t) > Xi(0)x3(0) > 0, 
hence q is not eliminated. 
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C More on discrete dynamics 



We now consider the limit C — )■ +00. If C ^ max(j x,y) y)| then 
ln(l + Qi/C) is approximately equal to Qi/C. From this remark we obtain 
the following result, which was shown by Cabrales and Sobel (1992), in the 
aggregate monotonic case. 

Proposition 5 Fix a game and functions gi; fix a mixed strategy q strictly 
dominated by a mixed strategy p. Assume either that the dynamics is aggre- 
gate monotonic (in the continuous-time sense) or that it is convex monotonic 
and that q is pure. Then there exists C* m M such that for all C > C, the 
discrete dynamics |5p eliminates strategy q. 



Proof. There exists e > such that 

V(x,y),^(p,-g,)f/,(y) >£ 

Therefore, under the above assumptions, there exists a > such that 

V(x, y), ^{Pi - qt)gi{^, y) > a 



For C large enough, 

V(^,x,y), 

so that 



In ( 1 + ^''^^'•^''^ ^i(X'y) 



c / c 



a 



V(x,y), ^(p, - g.)^.(x,y) > a/2C > 

where = InC + In (l + ^) = In (C + gi). The result follows. ■ 

Note that the constant C depends not only on the game and the functions 
gi, but also, through e, on the strategies p and q. Compare proposition [5] 
and proposition [3j Note that for aggregate monotonic dynamics, the order 
of the quantifiers (whether we first fix the game, the functions gi and the 
strategies p and q, or we first fix the constant C) is crucial. 

To conclude, note that if the constant C depends on the step n: 

Xi{n + l) =x^[n) r 17 

Cn + Efca;fcC/fc(x,y) 

then we have: 
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Proposition 6 Assume that Cn — ?■ +00 as n ^ +00 and that 



neN 



+ 00, 



Then for any game, any functions gi and any mixed strategies p and q such 
that p strictly dominates q, if the dynamics is aggregate monotonic or if it is 
convex monotonic and q is pure, then the discrete dynamics (11) eliminates 
strategy q. 



Proof. This follows from proposition |5j The condition ( 18 ) is needed for 
the dynamics not to slow down too much and "stop" . ■ 
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